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Abstract 

Covariance operators of random functions are crucial tools to study 
the way random elements concentrate over their support. The prin- 
cipal component analysis of a random function X is well-known from 
a theoretical viewpoint and extensively used in practical situations. 
In this work we focus on local covariance operators. They provide 
some pieces of information about the distribution of X around a fixed 
point of the space xq. A description of the asymptotic behaviour of 
the theoretical and empirical counterparts is carried out. Asymptotic 
developments are given under assumptions on the location of xq and 
on the distributions of projections of the data on the eigenspaces of 
the (non-local) covariance operator. 



1 Introduction 

1.1 The general framework 

A recent and considerable interest has been given along the last years to the 
statistical analysis for functional data. Usually mathematical statistics or 
probability theory deal with data modelled as random variables i.e. mea- 
surable mappings from an abstract probability space A, P) to a finite 
dimensional space. If a sample is denoted Xi,..,X„, the X's take values 
classically in R or W. In our framework we turn to random elements with 
values in an infinite-dimensional function space denoted JF. In the sequel JF 
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will be endowed at least with a separable Banach space structure with norm 
||-||. In everyday 's life, situation where such data appear are quite common 
: monitoring the value of a share yields a random curve X (t) where t runs 
along the quotation time. Even more basically, observing the temperature 
at a given place along the day and during n consecutive days provides a 
"theoretical" sample Xi{t) , ...,Xn{t) where t e [0,24]. Here "theoretical" 
means that temperatures will be recorded each day at fixed moments. For 
instance Xi will be observed at ti, ...tmi , hence the true curve Xi (t) will have 
to be reconstructed from the finite real valued sample Xi (ti ),..., Xi (tmi) by 
interpolation techniques such as splines, wavelets, cosine bases, etc. For fur- 
ther references about this topic see Chui (1992) and Antoniadis, Oppenheim 
(1995) about wavelets and de Boor (1978) ou Dierckx (1993), about splines. 

It turns out that probabilists have studied such random elements for a 
much longer time than statisticians (first works on the Brownian motion date 
back to the XIX*^ century), the first monograph dedicated to functional data 
was published in 1991 (Ramsay and Silverman (1991)). Modern computers 
make it now possible to carry out calculations for very high dimensional vec- 
tors and practical statisticians have shifted their interests to functional data 
or to so-called "high-dimensional problems" that fall within the scope of this 
paper. However a theoretical gap remains because not all asymptotic results 
have been given yet for such data. Besides probability theory unfortunately 
sometimes just give clues and not solutions to typically statistical issues (see 
later the paragraph devoted to small ball problems) . 

The interested reader could get familiar with the applied aspects by read- 
ing the monographs by Ramsay and Silverman or by Ferraty and Vieu (2006). 
Many probabilistic results will be found in Vakhania, Tarieladze and Choba- 
nian (1987) or in Ledoux and Talagrand (1991). 

In this setting we can define the expectation of X as : 



where fix — PoX~^ is the image of measure of P through the mapping 
X. The integral is of Bochner type and is defined whenever the real valued 
random variable ||X|| is integrable. 

In this article we focus on a very useful and common statistical technique : 
principal component analysis (PCA for short). The functional version of the 
PCA was initially studied by Dauxois, Pousse and Romain (1982). We refer 
to this seminal article for a complete mathematical definition. Briefiy speak- 
ing functional PCA of a process X (■) comes down to the spectral analysis of 
the covariance operator associated to the sample (see below for definitions). 
We refer for instance to Silverman (1996), Ocana, Aguilera and Valderrama 
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(1999), Kneip and Utikal (2001), Yao, MuUer and Wang (2005), or Cardot, 
Mas and Sarda (2007) to overview some applications and extensions of the 
functional PCA. Also note that He, MuUer and Wang (2003) introduced a 
version of canonical analysis for random functions. 

1.2 The Hilbert setting 

The abstract framework defined above is too general for statistical purposes. 
We will restrict ourselves to special spaces T but we will gain in terms of in- 
terpretation of our assumptions and results. Indeed we will assume once and 
for all that JF = i/ is a separable Hilbert space endowed with inner product 
(•, •) and associated norm ||-|| . Several reasons can explain this tightening. 
First of all we know that each function X may be decomposed in denumer- 
ablc bases. In practical situations these bases enable to get observation- 
curves from the discretized ones (see first paragraph above) by interpolation 
methods mentioned above. The following step is then achieved : 

AT 

CfcCfc (t) . 

The Sobolev spaces H^™'^ are classical examples of such Hilbert spaces : 
W^^^ ([0,T]) = j/ e ([0,T]) : C (/« {s))^ ds < +oo 

where T > and denotes here the derivative of order k oi f. 

Besides as we will focus on covariance operators the Hilbert setting yields 
considerable simplifications. Bounded linear operators were extensively stud- 
ied as well as their spectral properties (sec references below). We introduce 
the two following operator spaces and associated norms. 

The Banach space £ {H, H) = Cis the classical space of bounded operator 
endowed with the norm defined for each T in £ by : 

ll^lloo = sup \\Tx\\ , 

where Bi is the unit sphere of H. The Hilbert space £2 is the space of Hilbert- 
Schmidt operators, (£2 C £) i.e. the space of those operators T such that, 
given a basis of H, say {ek)^^^ , 

+00 

k=l 
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It is a well-known fact that £2 is a separable Hilbert space whenever H is. 
The inner product in C2 is : 

+00 

k=l 

and does not depend on the choice of the basis {ek)k^fq- The space of trace- 
class (or nuclear) operators Ci endowed with norm ||-||^ will be mentioned 
sometimes in the paper. These norms are not equivalent and 

The canonical injections from Ci onto £2 and from £2 onto C are conse- 
quently continuous. For further information on linear operators we refer 
to Schmeidlcr (1965), Wcidman (1980), Dunford-Schwartz (1988), Gohberg, 
Goldberg and Kaashoek (1991) amongst many others. 



2 Covariance and local covariance operators 
of random Hilbert elements 

Let the tensor product between u and v in H stand for the one-rank operator 
from if to if by : 

{u <S> v) (t) — {u, t) V 

for all t in H. 

Since covariance operators are undern concern within functional PGA, 
we should first of all define them and give some of their main features. The 
theoretical covariance operator F and its empirical counterpart, F„, based on 
the independent and identically distributed sample Xi, ...,Xn are symmetric 
positive trace class operators from H to H defined by : 

F = E((Xi-EXi)® (Xi-EXi)), (1) 
1 " — — 

F„ = - J] (Xfe - Xn) ® {Xk - Xn) (2) 

k=l 



where 



2 

— — / 

k=\ 



If X is centered EX = and F = E (X (g) X) . By (A^, e^) we denote the A;*'* 
eigenelements (eigenvalues/eigenvectors) of F. The A^'s are positive and we 
set Ai < A2 < and {\k)^^^ G l\. 
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In the Hilbert setting, the distribution of a centered random element say 
X may be characterized a very simple way. Indeed if denotes equality in 
distribution : 

+00 

X —d ^ V^Ck^k (3) 
k=l 

where the ^^'s are centered non- correlated real random variables with unit 
variance. The above decomposition is often referred to as the Karhunen- 
Loeve development or development of X with respect to its reproducing 
kernel Hilbert space (RKHS). For definition and studies of RKHS we refer 
to Berlinet, Thomas- Agnan (2004). 

Now we introduce the definition of local covariancc operator. Let K 
be a kernel, that is a nonnegativc function defined on and such that 
J K (s) ds = 1 and let h = h (n) be a bandwidth. Pick xq a fixed vector in 
H {xq will be a function if is a space of functions). In the sequel we will 
often need to decompose Xq in the basis Ck : 

+00 

k=l 

where 

+00 

{xo,ekf < +00. 



fc=i 



Definition 1 The theoretical local covariance operator of X at xq E H based 
on the kernel K and its empirical counterpart are respectively defined by : 

Tj^^eI^K (^^^-^) ((^1 - ^0) ® (^1 - ^0))) , (4) 

rK,n ^-Y.K /"H^LZM") ((X, - xo) ® (X, - X,)) . (5) 
^ fc=i ^ ^ 

Even if Vk and „ may have already been introduced elsewehere in 
articles dealing with functional data (see for instance Ferraty, Mas, Vieu 
(2007)), it is the first attempt, up to the author's knowledge, to provide these 
operators with a name. Note that Vk implicitcly depends on n through h, 
even if this index does not explicitely appears. These operators are crucial 
in the nonparametric estimation of the regression function by local linear 
methods amongst others (see the conclusion for further details) . 
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Proposition 1 The local covariance operators and Tx^n are positive, 
selfadjoint. Besides they are trace class whenever K is hounded and 



or when K is hounded and compactly supported. 

The proposition is plain since tlie trace-class norm of Tk for instance is 
bounded by : 



In the sequel by {\k)k(m (resp. {Xk,n)km) ^'^'^ (^fe)fceN (^^sp. {■Kk,n)ken) 
denote the eigenvalues and the associated eigenvectors of Tk (resp. T^.n) 

The main goal of this paper is to describe the asymptotic behaviour of 
Tx and F^.n and to derive results for their eigenelements. 

3 Intermezzo about Gamma varying functions 
and the small ball problem 

It may be proved that whenever the random variable X takes values in a 
finite dimensional space, say MP, the covariance operators defined at displays 
(jll) and ([5]) depend on the value of the density of X, if we assume that X 
admits a density at point xq- Besides one may use a larger class of kernels 
(here since ||Xi — xo\\ is positive we are restricted to kernels with positive 
support which damages the rates of convergence). It is simple to prove that 
when X is a real- valued random variable that exhibits a non-null density / 
at xq with some regularity around xq : 



We refer to Fan (1993) for illustrating the issues of asymptotics for truncated 
moments in nonparametric regression estimation. 

In our infinite dimensional framework the situation is quite different : 
since Lebesgue's measure is not defined on Hilbert spaces, the notion of 
'density' cannot be defined either. It turns out that the density will be 
replaced by the "small ball probability of X" , which is nothing but the 



E(||Xif) < +00 
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cumulative density function for the norm of X (or X — xq) in a neighborhood 
of i.e. P (||X — XqII < e) for e I 0. The random variable X may be replaced 
by any process Zt,t G T. The study of small ball probabilites is not new 
and is connected with the theory of large deviations (since ||X — xo|| will 
be large when e decays to zero). We refer to Ledoux-Talagrand (1991), Li, 
Linde (1999), Li, Shao (2001) for some more information about this topic. 

Since these small ball probabilities appear in the main results of this ar- 
ticle and are of much importance within the proofs, we collect a few results 
about them in order to be more illustrative. We provide two examples di- 
rectly based on display (I3l). The small probability then heavily depends on 
the rate of decay of the eigenvalues of the covariance operator, namely the 
Afc's. 

If the rate of decay is arithmetic x k^^^^°'\ The problem was solved 
in Mayer- Wolf, Zeitouni (1993). They get : 

P(||X||<.)~exp(-^). (6) 

where C [a) is some positive constant. 

When the rate of decay is exponential : Afc x exp {—ak) , the calculations 
may not have been carried out. I did not find them elsewhere. They may be 
derived from formula (10) in Dembo, Mayer- Wolf, Zeitouni (1995). 

Proposition 2 When A^ x exp {—ak) in then for e ^ : 



The proof of this apparently new result is postponed to the end of the 
last section. 

Let us leave the small ball probability for a moment. At this point we 
need to give some properties of a class of real functions. The statistician 
may be familiar with the definition of functions with regular variations since 
they appear in the theory of extremes. For instance / : M — ^ R is regularly 
varying at with index d if , for all fixed x in M : 

V fihx) a 
hm ^9—^ = x^. 

h^o f{h) 

A less known class of functions studied in the theory of regular variations is 
the so-called "class F". This class F will be of much use in the sequel. It was 
introduced by de Haan (1971), see also de Haan (1974) in connection with 
the theory of extemes. But Gai'ffas (2005) used it to model the distribution 
of "rare" inputs in a non-parametric regression model : a density which is 
null and F- varying at xq will generate a distribution which rarely visit xq. 
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Definition 2 A function f belongs to the class T at (or is T -varying atO) 
if there exists a measurable positive function p such that for all x eM. : 

The function p is called the auxiliary function of f . 

We refer to Cliapter 3.10 in Bingliam, Goldie, Teugels (1987) for a deeper 
presentation and tfie essential properties of regularly varying functions and 
of the class F (see p. 174-180). The reader should be aware that, in this book, 
the authors consider only functions that are F-varying at infinity. Their 
definitions and properties must be adapted to our setting : here functions 
are F-varying at 0. We collect now only those properties which will be used 
throughout the proofs : 

Fact 1 : If / e F, for all x G [0, 1[ 

hm ^ = 0. (9) 
Fact 2 : If p is the auxiliary function of / G F, then 

^ 0, (10) 

S s^O 

p{s + xp{s)) 



p{s) s^O 



1 (11) 



when s goes to and for all x G M. 

Fact 3 : If / G F then F (x) = f (s) ds belongs to the class F too and 

f{s)dS f{h)p{h). (12) 

Now we turn again to the small ball probabilities. The following Propo- 
sition explains why the class F was introduced. 

Proposition 3 Functions defined on displays ^ and ^ are both T -varying 
at with auxiliary functions : 

and 

p{s) = -s/ (2a logs) 

respectively. 
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The proof is omitted since it is straightforward. The previous Proposition 
is quite important for the sequel 

It is seen from (jlj) for instance that the random element X is shifted from 
the origin by —xq. Obviously small ball probabilites defined at displays ([6]) or 
(171) do not exactly match our goals. The shift, — Xq is nonrandom but however 
the small balls probabilities may tremendously differ from those given above. 
It turns out that when xq lies in the reproducing kernel Hilbert space of X : 

P(||X-xo|| <e)r^C{xo)F{\\X\\<e) (13) 

where C (xq) is a constant which depends only on xq and x should replace 
~ in ([H]) and ([7j). The articles by Li, Linde (1993) or Kuelbs, Li, Linde 
(1994) deal with the small ball problem for shifted balls. Since the small ball 
probability of X appears explicitely in the main results of this paper it is 
denoted for simplicity : 

F^, {e)=F{e)=F{\\X-xo\\<e). 

Within the proofs several calculations must be carried out that involve some 
analytic properties of F and we need to announce the following claim, in- 
spired by Proposition [3] and ffT^ 

Claim 1 The small ball probability functions F of shifted random elements 
in H (here X — xq) are assumed to belong to the class P. 

The assumptions needed to define correctly F^^^ (e) that may appear in 
Li, Linde (1993) or Kuelbs, Li, Linde (1994) are supposed to hold in addition 
to those that will be given below. 

Remark 1 This claim directly leads us to arising the following question : is 
the small probability (at 0) of any process defined by ^ T -varying at zero ? 
Answering yes would provide a universal "representation" of these small ball 
probability functions (see Theorem 3.10.8 p. 178 in Bingham, Goldie, Teugels 
(1987)). At this point we can answer only in the two important special cases 
mentioned above but this issue is under investigation (see Mas (2007)). 

4 Main results 

We study convergence for random (or not) operators. This section is tiled into 
three subsections. In the first one we provide theorems dealing with asymp- 
totics for the cells of some infinite matrix. Exact constants are computed. In 
the second subsection we get bounds in supremum or Hilbert-Schmidt norm 
for the operator(s) under concern. The third deals with the empirical local 
CO variance operator TK,n- 
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4.1 Cell-by-cell results 

First let us introduce the assumptions needed in the sequeL 

Assumption Ai : There exists a basis, say Cp in which the finite di- 
mensional distributions of X, the {X, Cp) 's are independent and all have a 
density fp. This density is such that (fp)^^^ ((xq, Cp)) 7^ for i G {0,1,2}. 
Besides the density of the nonnegative real variable 



+00 

A ^ - xo,ekf = \\X - xoW 

\ k=l 

exists in a neighborhood of and belongs to the class T with auxiliary function 
P- 

Remark 2 The notation Cp should not be misleading. The basis involved 
in Assumption Ai needs not to be the basis of eigenvalues of the operator 
r. But since in the important case of a gaussian random element X -with 
eigenvalues decaying at an arithmetic or geometric rate- Ai always holds for 
this special basis we will abusively keep the same notation. 

Assuming that the finite dimensional distributions are independent is 
needed to alleviate the proofs and to get exact constant in asymptotic expan- 
sions. Milder hypotheses on the joint distribution of the couple {{X, e^) , ||X || ) 
could certainly prevail at the expense of more tedious caclulations as will be 
seen from the proofs. 

Remark 3 Within Ai the assumption (fp)^^^ {{xo^Cp)) 7^ for i G {0, 1,2} 
could be replaced by the more general one : "Let us denote 

Xl = mi{k:ff'^\(,x^,ep))^^), 
iV; = inf{A;:/(2^+i)((xo,ep))^0}, 
Nl = \^i{k>Nl:ff^\{x^,ep)) + ^} 

and assume that and are finite for all p". But once more we prefer to 
lose generality and gain readability. Also note that switching Assumption 1 
to the one involving the 's leads to modified results in TheoremUl : indeed 
the speed of convergence would then depend on N^, and N^. 
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Assumption A2 : The kernel K is bounded, [0,1]- supported, K {1) > 
and 

sup \K' < +00 

se[o,i] 

This assumption is not too restrictive and could certainly be replaced by 
a milder one. But it is out of the scope of this article to provide minimal 
conditions on the kernel K. 

We start with a development of Tk- Let 6ij be the Kronecker symbol 
{6ij = 1 if and only if i = j, otherwise). 

Theorem 1 Assume Ai and A2. When h goes to the operator also 
tends to zero. And the following holds : for fixed i and j in N, 

{Vk (h) (Ci) , e,) ~ V (h) + w (h) 7^^,•, (14) 

where v {h) and w {h) are two real nonnegative sequences defined by : 

v{h)=^ (^K (^^^) ||X - xoll p (||X - xoId) , (15) 

w{h)=^ (k (^^^) 11^ - a:of (11^ - a^oll)) (16) 

and where the doubly indexed field TZ is defined by : 

/r((^o,e.)) 



7^ 



fi {{xo.ei)) 

/a(^o,e.))/j((xo,e,)) 



Theorem [T] provides asymptotics for each cell of the infinite dimensional 
matrix Tk when expressed in the basis (ei)]^<j<„. Introducing the operator 
TZ defined in the basis (ej)^<j<„ by {TZei,ej) = IZij we could rephrase this 
theorem by saying that " Vk is asymptotically equivalent " cell by cell" to the 
operator v {h) I + w {h) TZ" . 

At this point the reader is not given much information on both sequences 
V {h) and w {h) . It is actually basic to see that both sequences tend to zero. 
The next subsection will provide the reader with a more explicit description 
of the rate of decrease. 

The next Proposition and the two next remarks give seminal properties 
of operator IZ. 
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Proposition 4 // both following conditions hold 



i=l 
+00 



j=i 



TZ is Hilbert- Schmidt. If [Tl\) is replaced with 



C'l : ( ) e /oo (resp Co) (19) 



/i((a;o,ei)) 



the operator TZ is bounded (resp. compact). 

When either ( fl^) or ( f7P|) does noi /io/d, TZ is a symmetric unbounded oper- 
ator. 

The proof of this Proposition is omitted since it is a consequence of the 
following remark. 

Remark 4 The operator TZ may be rewritten : 

IZ = T ® T + diag (sj) 

where 

f'l {{xQ.ei)) /a ((^0,62)) 
/i ((a;o,ei))' /2((xo,e2))''", 
= ((ln/i)'((xo,ei)),(ln/2)'((a;o,e2)),...) 
Si = (In/i)" ((xo,ei)) , 

and diag (sj) denotes a diagonal operator expressed in the basis Cj with i 
term Sj. When [T^) holds t & H. 

Before going into deeper details we should examine a typical situation, 
namely the case when X is a gaussian random element. The following Propo- 
sition shows that even in this basic situation, serious problems occur. 

Proposition 5 If X is gaussian and centered : 

fl{{xo,ei)) ^ {xo,ei) 
fi{{xo,ei)) Xi 
f-{{xo,ei)) f {xo,ei)\ 1 



th 



fii{xo,ei)) \ Xi J Xi 

and conditions fT^) and ( I7P|) of Proposition cannot hold together which 
also means that the operator TZ is always unbounded in this setting. 
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Let us focus on these conditions since they may be easily interpreted. 
Indeed assuming ( IT^ : 

i=l ^ ' 

means that the coordinates of xq should decrease much quicker to zero than 
the eigenvalues which also means that xq should be smoother (more regular) 
than X itself. On the other hand (fT9l) will hold whenever (xq, Cj)^ = Xi + Xfrt 
(where t E loo (resp Cq)), and Xq should then be as regular as X but - 
surprisingly- not more... 

Considering again the unusual conditions Ci, C2 the reader may become 
suspicious and the situation in the gaussian framework makes it legitimate 
to wonder whether there exists a family of densities and an xq such that 
these conditions hold. The answer is positive and gives birth to the following 
Proposition. 

Proposition 6 Let be the symmetric density defined on M by : 
and take {xq, Ci) = Xi such that 

+00 2 

X 

1=1 ' 

Then ([T^j and ^E) both hold. 

The proof of the Proposition is omitted since it stems from straightfor- 
ward computations. 



4.2 Norm results for the local covariance operator 

The next issue is obviously to strengthen Theorem [T]: Is it possible to replace 
the " cell by cell" or " componentwise" convergence by convergence in norm ? 
First of all note that we may expect the rate of convergence to be v {h) but 
we have to be cautious for several reasons : 

• First of all 71 may be unbounded. In that situation we cannot expect 
a result such as : 

Tk -{v{h)I + w (h) 7^} ^ 
in norm since w {h) TZ may not even be bounded whereas Tk is. 
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We may have — v {h) I ^ but we cannot get 



for topological reasons : is for all h a compact operator and cannot 
converge to the identity operator (which is not compact) since Cc is a 
closed subspace of C 

Even worse : may be asymptotically bounded or unbounded i.e. 



lim sup 



K 



v{h) 



< M or lim sup 



K 



v{h) 



+00. 



The following example will illustrate the points above. Take T a diagonal 
operator expressed in a basis of H and defined this way : T (h) = diag {ai (h)) 
where 

A- /i^/^ 

h I and A G /i. The reader will be easily convinced that we are in a situation 
similar to the one of theorem [T] : the i^^ cell of the bounded operator T is 
asymptotically equivalent with h + h^^'^/Xi. Here v (h) = h, w (h) = h?^'^ and 
IZ =diag (A~^) is unbounded. Then it is elementary algebra to prove that : 



\T{h) - hi 
T{h) 



h 



< h^'^ ^ 0, 

= 1 + 



+ CXD. 



(20) 



However if 



{h) = h 



+ 



\i + h \i + h 



T{h) 



h 



2. 



Let us focus again on the local covariance operator Tk- If one tries to 
bound its norm a first attempt gives : 



ir 



K\ 



< E 



E 



K 
K 



|X — xo| 
h 

h 



{{X-x^)®{X-x,)) 



\X - Xq\ 



(21) 
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The next theorem assesses that under mild conditions that hold in the gaus- 
sian framework this bound is not sharp. At this point we should turn back 
to Theorem [H especially to the sequences v {h) and w {h) mentioned within 
this Theorem. The next Proposition provides first a bound then under an 
additional assumption an equivalent sequence for v {h) . The case of w (h) 
will not be treated since the inspection of the method of proof would easily 
lead to similar results. 



Proposition 7 Let as above 



v{h)=m[K 



then 



h 



v{h) 



E 



|X-xo||p(||X-xo| 



0. 



k(\\^) \\x-x4 

Besides if p is regularly varying at with positive index 

v{h) K{l)hp{h)F{h). 

Remark 5 The auxiliary functions appearing within Proposition are both 
regularly varying with indices : 



for the first and 



d= (3 + 4a)/(l + 2a) 



d 



for the second. 

It is time for us to state the second main result of this paper. This 
Theorem is in a way complementary to the previous one. It provides an 
asymptotic first order development of T^- 

Theorem 2 Suppose Ai and A2 hold. Let Vq be a fixed neighborhood of 
and 

fi {t + {xo,ei)) - fi {{xQ,ei)) 



sup 

ieVo 



we have 



fi {{xo,ei)) 

i=l 

TK-vih)I\\^ = Oivih)). 



+00 



(22) 
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Remark 6 By Proposition the Theorem just provides a bound sharper 
than the rather "naive" one at display / f^) since obviously due to 01^) . A 
better result would be to obtain a second order term which would mean here 
to provide the explicit operator hidden behind the "O {y {h))" . This has still 
to be done and holds perhaps under reinforced assumptions on both xq and 
the fi's. But TheoremUl as well as the examples treated above (see display 
^EW) '^^ claim that : "if ever [Tk — v (h) I] / s {h) converges in norm, then 
necessarily s {h) = w {h) and the limiting operator is then TZ" . 

Remark 7 It has been seen above that we could not expect to obtain a 
O {w {h)) on the right, instead of O {v [h)) because in many situations the 
operator TZ will be unbounded. We see that the price to pay to enhance a 
"weak" result such as TheoremU\to a "uniform" one such as Theorem\^is 
a slower rate of decrease since obviously 

v{h) ^ 

Assumption fl22p must be commented and illustrated by investigating 
some examples. 

Example 1 (Gauss) If X is gaussian, straightforward computations lead to 

fi {t + (xo,ei)) - fi ((xo,ei)) ( -t^ -2 {xo,ei)t 

fi{{xo,ei)) V 2Ai 

and if i is large enough (hence {xo,ei) small enough). 



a,; 



exp 



2A,; 



Then if tends to zero. 



ai < 



4Ai 



and /dl) holds when 



E%?^<+-- (23) 



4 
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Example 2 (Laplace) If 



2\ 



exp 



\t\ 



we have 

fi {t + (xo,ei)) - fi ((xo,ei)) 



exp 



fi {{xQ.ei)) 
and assumption holds when 

\{xo,ei)\ 



|(xo,ej)| - \ {xo,ei) -t\ 
2\i 



E 



=1 >- 



exp 



2\i 



< +00, 



hence when 



{xo.ei) 

i=l 



< +00. 



Example 3 (Unimodal densities) Since X is assumed to be centered and 
the fi 's are the densities of the random variables {X — xq, Ci) , we may ex- 
tend both previous examples to a slightly more general situation. Indeed both 
variance and expectation of {X — xq, Ci) tend to zero (they are respectively Aj 
and — (xo, Cj) ) and we can consider the case when fi features a single peak 
(a mode) at — (xq, Cj) ) and concentrates around 0. Then 

/,(0)-/,((a:o,e,)) 



fi {{xQ,ei)) 

If we try to go beyond this relationship, a simple development of fi around 
zero provides : 



fli{xo,ei)) , {xo,eif fl'{ci) 



+ 



fii{xo,ei)) 2 fi{{xo,ei)) 

where Ci lies somewhere between and (xo,ej) Then it is plain to see that 
assumption [2E) turns out to hold when : on a first hand ( applying Cauchy- 
Schwartz inequality) condition C2 holds and on the other hand when 



sup 



< +00 



fi {{xo,ei)) 

which is not exactly assumption C'l but which is not that far. Developping 
fi up tofl" would let C'l appear but would also creates an additional term. 
This does not prove that [2^) is a necessary and sufficient condition for 
convergence ofT^ in the sense of Theorem\^ But the closeness of ( f^) with 
the "weak" conditions C'^ and C2 shows that Theorem is obtained under 
rather mild assumptions. 
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Remark 8 It has been assumed throughout the paper that X has null expec- 
tation. When EX 7^ 0, the theorems continue to hold but assumptions such 
as may implicitely involve this expectation itself. For instance f2^} is 
replaced by : 



E 



{Xo + H^Ci)^ 

A2 



where /i = EX. More generally speaking in the situation when the X's are not 
centered, a condition involving Xq should be replaced by the same condition 
involving Xq + /i. 



4.3 Convergence of the empirical covariance operator 

We go on with asymptotics for the empirical covariance operators, namely 
mean square error. This part is short since the most delicate issue was sorted 
out in the previous section. 

Theorem 3 When assumptions Aiand A2 hold the following asymptotic re- 
sults are true : 

E||r;,,-r^t = ^^i^^(i) (1 + 0(1)) 



The same sort of results hold for the eigenelements. Recall that (A„ 



(resp. (Ap)pgj^) stands for the eigenvalues of T^n (resp. Tk) and (vr„_p)pgj^ 
(resp. (7rp)pgj^) stands for the associated eigenprojectors. The following The- 
orem estimates the rate of decrease to zero for the eigenelements. 

Corollary 1 Under the same conditions as in Theorem\^ for fixed p G N, 

E(A„,-A,)^ = 0^^'^^^) 



E ||7r„,p - TTpll^ = O 



n 

h^F (h) 



n 



Only a sketch of the proof of this Corollary is given since it may be seen 
as a by-product of an article by Mas and Menneteau (2003). Under simple 
additional assumptions, exact constants could be computed in both above 
displays by applying the formulas that appear in Theorem 1.2 p. 129 in their 
article. But these computations are beyond the scope of this article : they 
make it necessary to introduce and explain Kato's perturbation theory as 
well as the associated functional calculus for linear operators. The inter- 
ested reader is referred to Kato (1976), Dunford-Schwartz (1988), Gohberg, 
Goldberg and Kaashoek (1991). 
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4.4 Conclusion and perspectives 



We proposed a first approach to what we named "local covariance operators" . 
This article does not aim at giving an exhaustive list of their features but 
provides some clues for further and deeper study. For instance we can take for 
granted that small probabilities naturally appear when estimating the rates 
of convergence and that the class of F-varying functions ( at 0) provides 
an accurate setting. It also turns out from Theorem [T] that the asymptotic 
behaviour of Tk is quite unusual and let appear, through TZ, an unbounded 
operator operator whereas F;^ tend s to zero. 

Several issues will have to be addressed in the future. We can list some 
of them. The case of first order truncated moments, that is : 



E 



{X-xo)K 



( 


X -xo 


)1 




h 





could certainly be studied in the framework of this article and with the 
same computational techniques. Almost sure convergence as well as weak 
convergence (convergence in distribution) could be adressed by following the 
same lines. 

Another crucial issue is the existence and the properties of the inverse 
of Tk when it exists. Indeed let us introduce the nonparametric regression 
model for functional random variables : 



y = riX)+e, 

where {y,X) G M x i^. Investigating a pointwise estimate r (xq) of r (xq) by 
local linear methods leads to finding the inverse (or a pseudo-inverse) of F^^-. 



5 Mathematical derivations 

For any x = Yli^k^k in H and for (i, j) G N^, i ^ j, set 

II l|2 _ \^ 2 

II l|2 — 2 

k7^i,j 

and denote f^i the density of ||Ar||_^- as well as /^jj the density of ||Ar||_^.^.. It 
is clear that when assumption Ai holds {X,ei) and ||Ar||_^- are independent 
random variables. 
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In order to alleviate the notations, within the proofs -unless explicitely 
mentioned- X will stand ior X—xq {xq is dropped since it is fixed but we keep 
aware that all our results and notations, especially small ball probabilities 
depend on xq) and fi for the density of {X — xo, Ci). 



5.1 Preliminary material 



We begin with preliminary Lemmas which are assessed in a general setting 
and will be applied later. We recall the definition of the Gamma function F 



r(u) 



f 

Jo 



exp (— s) ds. 



Lemma 1 If f belongs to the class F with auxiliary function p, then for all 
peN, 



tP 



dt ~ 2—r 



P-i /p + 1 



/(«) 



p{s)\ 2 



Proof. We start with the following change of variable : s^/l — t"^ = s—p (s) x 
[ f( sVl^) dt 

Jo VT^ ^ ^ 



£--1 

2 



2^ IP^'^ 



p+i 
2 



f{s) 



s/p{s] 



f{s-p (s) x) dx 

p-1 



x{l + 



2s 



f{s-p{s) x) 
f (s) exp {-x) 



exp {—x) dx. 



To conclude it suffices to prove that 



■/Pis) 



x{l + 



' «5zigM.exp(-x)d:.-r(i^) 



But the numerator may be rewritten 



0. 



s-*0 



fs/p{s) f f 



2s 



f{s-p (g) x) 
f (s) exp (-x) 



p-i 



X 2 exp (—x) dx. (24) 



Let us study briefly the sequence of functions /(g) exp(-i) • '^^^ ^^S" ^^^^ 
order derivative is the sign of : 



f{s-p{s)x) 
f'{s- p (s) x) 
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-Pis) 



By Theorem 3.10.11 in Bingham, Goldie, Teugels (1987), /' is F-varying 
with same auxihary function as / and by Corollary 3.10.5 (b) p. 177 ibidem 
we know that 

/ f ^ ^ /(g-p(g) x) 

p{s-p [s) x) = — — - 

f'{s- p{s) x) 

Then since p (0) = and p > 0, p is strictly increasing in a neighborhood of 
zero and p{s — p{s) x) < p (s) , /(s)exp(-i) nonincreasing on [0, s/p (s)] (as 
a function of x) hence 

f{s-p{s)x) 

x&[o,s/p{s)] f (s) exp (-x) 

Now together with display ([H]) and ffTUj) we can apply Lebesgue's domi- 
nated convergence Theorem to which completes the proof of i HM the Lemma. 



The next lemma 

If U and Vare two real valued random variables, fuy denotes the joint 
density of the couple (f/, V"). We need to compute four densities : 

Lemma 2 We have : 

f{X,e,),\\X\\ {U, V) = ^ fi {u) f^i (Vv^ -uA 11{„>|«|}, (25) 

Vf ^ — M"^ ^ ^ 

/lixii (v) = V £ -^^U^ (vVT^) dt (26) 

and 

f{X,ei),{X,e,),\\X\\ {t,U,v) 



= / fi {vx COS 6) fj {vx sin 6) f^kij (vVl — x'^j dxdO. 

Jo Jo vi-x"^ V y 

Proof. We only compute the first density since we could get the second by 
integration. The third and fourth could be obtained the same way. Let h be 
any bounded measurable function. 

Eh {{X, Ci) ,\\X\\) = j h (^Xi, xl + fi (xj) f^i (jji) dx.dyi 

^ fi {u) f^i i^V^ - uA M{.,>\u\}dudv 



\/v'^ — u 
h (u, v) f{x,e,),\\x\\ (u, v) dudv. 
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Identifying both last terms we get 

/(X,e,),||X|| {U,V) = ^ fi (u) f^i (Vv^ -uA ]1{„>|„|}. 

Integrating this density with respect to the variable u yields (^) as in 
(ESI). ■ 



Lemma 3 The following hold : 

f\\x\\ (v) ~ r (^0 V^M^)h (0) (v) , 

/lixii {v)r^2nf,iO)f,iO)vpiv)U,,iv). 

Besides if f\\x\\, f^i and f^ij are T -varying for alii and j then they have all 
p as auxiliary function. 

Proof. We restrict to proving the Lemma for /^j. From Lemma [T] and fl26p 

we get 

/lixii (v) = V f ^ ^^U^ [vVT^) dt 

^"^^ W^^^' {vVl^) dt 

~ r (0) z^, (v) 

where pi denotes the auxiliary function of /^j. Now we also have for all x > 

{V + Pi jv) X) ^ a/2 (f + Pi (v) X) Pi {V + Pi (v) X)fi (0) f-Li {v + Pi (f ) x) 

hx\\ {v) ^ V^^mi^fi (0) f^^ (v) 

V + Pi (v) x) Pi {v + Pi (f ) x) 

exp [x) . 



y vpi [V 

The term 

V + Pi (v) x) Pi {v + Pi (v) x) _ f ^ ^ Pi {v) x\ f Pi{v + Pi {v) x) 



VPi (f ) V V J \ Pi (v) 

tends to 1 by Fact 2. Finally 

{v + Pi (v) x) 



f\\x\\ (v) 
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exp (x) 



and Pi is also the auxiliary function for Since is also F- varying 

with auxiliary function p, we can set Pi = p (the auxiliary function is unique 
up to an asymptotic equivalence, see Corollary 3.10.5 (b) p. 177 in Bingham, 
Goldie, Teugels (1987)). The same steps would lead us to the second part of 
the Lemma. ■ 

5.2 Proof of cell- by-cell results 

By "cell" we just mean that, identifiying Tk with an infinite matrix, we 
consider in this subsection asymptotics for {VK^i^^j) ■ We study first the 
diagonal of Vk '■ 



Proposition 8 Fix the index i G N .' 




Corollary 2 From the above we deduce that : 

E[(X,e,)'| ||X|| =t;] ^vp{v). 



Proof. We start from the joint density at display (l25i) : 



E 



K 




\X\ 

T 

K 



u 



hJ 



h {u) (y^;^^) dn\ dv (29) 



X- 



rfi (xv) f^i (vVl - x^^ dx j dv 
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Setting : 



we have 



III ^0^fi M Ui (^Vl - a;2) dx 



E 



K 



(30) 



We focus on / (v) and prove that : 



l + vp (v) 



It is clear that from f l30ll and ( ISTl) we can derive f l28l) . 



Now from /, (xt;) = /, (0) + vxfl (0) + ^/f (0) + o{i 



(31) 

we can develop 



li (v). Setting : 
we get : 



1 



x'^) dx ] p G N, 



h (0) (t;) + (0) J4 (^ 



fi (0) Jo (^) + f /f (0) (i; 

Jo (^^) 1 + 2^^^ + 



(1 + ^(1)) 



Joiv) 



1 + 



2 MO) Joiv) 



2 /.(O) VJ2(t^) Jo(^) 



(1 + 0(1)) 



Then we invoke Lemma [T] and Lemma [3] to get 

J2(^^) P{V 



hence 



Idv) 



Jo{v) 
Ja{v) 

J2{V) 



V 

,p(^) 



(l+o(l)), 

(1 + 0(1)) 



1 + |^^P(^)) (1 + 0(1)) 



which finishes the proof of the Proposition [HI 
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Proposition 9 Let us take i j in N, we have 



E 



K 



h 



(X,e,) (X,e,) 



// (0) /' (0) 



/.(0)/,(0)7o 



K[-) v p {v) f\x\\ {v) dv. 



Proof. The proof basically follows the same hnes as the previous Proposition 
with a few changes : 



E 



K 




{X,e,) {X,e,: 
/w\ utv 

K 



X 




sin cos 9 

_ J.2 



fi (r cos 61) /j (rsin6') f^ij (Vv'^ - r^^ IL{„>r}drd6'j 

(32a) 



sin 9 cos ^ 



X 




fi {xv COS 9) fj {xv sin ^) /^^ ^vVl — ll{i>a;>o}cix(i^ j dv 



I v'K Q J (v) /iixii {v 



) dv, 



(32b) 



where 



lo " /o T^fi (^^ ^) (^^ ^) /^iJ (^Vl dxd^ 
At last we prove that : 



J(v) 



n (0) /j (0) 2. X 

/,(0)/,(0)^ 
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and go quickly through it : 



V 



VT- 

'■2tt fl 



r27r rl 

Jo Jo 

/o'" /o' (a^^ cos /, {xv sin ^) /^,, {vVT^) li{,>,>o}dxdd 



h (0) /, (0) /; /^., (i^yr^) dxde 

fl (0) /j (0) t sin' ^ cos^ 9d9 ^U,, (vVT^) dx 



(l + o(l)) 



2vr/,(0)/,(0) 

fl (0) /j (0) vr Js (^) 
2vr (0) /, (0) 4 (t;) 



/o^ Tfe/^^ii {Wl-x^) dx 



(1 + 0(1)) 



(l + o(l)) 



,. ;.(0);.(0)2^r(3) 

8 /. (0) /, (0) r (1) 

/(^) (1 + 0(1)) 



(1 + 0(1)) 



// (0) /; (0) , 



/.(0)/,(0)' 

This last step ends the proof of Proposition [9l ■ 

Proof of Theorem [T] : The proof of the Theorem stems from Proposi- 
tions M and M For instance, 



vp (v) K i^-j (v) dv 



5.3 Proof of norm results 



E 



II^IIp(II^II)^ 



ll^ll 



We decompose Fx into two terms : a purely diagonal one and non-diagonal 
one. In fact : 

(r^ei,ei) = {TKei,ei) 
rle,,e,) = i^j 



and 

We first prove that : 
Lemma 4 



i- K - ^ K - i- K- 



\T%-v{h)l\\=0{v{h)) 



(34) 
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It suffices to prove that 



sup I {Txei, Ci) - V {h) \ = O (v (h)) 



Let us denote : 



fi it) - U (0) 



We have 

sup \ipi {t)\ = tti 

teVo 

where Oj was introduced in Theorem O 
We start from (1301) and (EH) : 



{TKei,ei) -v{h) 



E 



K 



v{h) 

t'K (0 /, (t) f^\xi\ (t) dt - £ tp (t) K (^^^ it) dt 

Pity 



t^K 



h 



We will ffist focus on : 



f\\x\\ (t) dt 

J2{t) J2{t) p{t) 

Jo it) Jo it) t 



(35) 



Let us develop 

J2(t) 



Jo it) 



1 1 



It is plain that 



Now denote 



I^ it) = 

Jo it) 

j; it) 



VT- 



I-i Tfc (1 + ('^^)) {tVT^ dx 



1 x^ 



1 VT^^ 



V'i (^3:) f^i (tVl — x"^^ dx 
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then 



hence 



hit) 



Jo (t) + Jo* it) 



hit) 



J2 it) + it) 

J2 it) _ j; it) Jo it) - J2 it) Jo* it) 



Joit) Joit)iJoit) + Jo*it)) 
We are going to use the following inequalities : 

\Joit)\<aiJoit) 
\J2it)\ < aiJ^it) 
Jo it) + Jo* it) > Jo (t) (1 - ai) > 0. 



They yield : 



Turning back to 
X 



h it) - 



we get : 



J2it) 



Joit) 



< 



2q. J2 it) 
;i - ai) Jo it) 



E 



< 



K 

2a 



h 



vih) 



1 - «i JO 



t \ J2 it) 



hj Jo it) 



f\\x\\it)dt+ / eK 
Jo 



t\ fJ2it) Pit) 



hJ \Joit) 



f\\x\\ it) dt 



Remind that, in order to alleviate notations we remove the index i Jq if) and 
J2 it) . Assume that 



r ^2 it) t 

hm sup sup ^ , , — -— < M 

t^o i Jo it) P it) - 



(36) 



then we get 



lim sup 

h-fO i 



E 



K 



\X\ 



-vih) 



< 



2a,M 



1 - ai 
< M'v ih) 



+ M + 1 / tpit)K[-\fiix\\it)dt 



where M' is some constant which does not depend on i or h. This finally 
entails Lemma Hlln order to finish the proof we prove (|36l) now as a Lemma. 



Lemma 5 We have 



V ^2 it) t 

hm sup sup ^ , , — < ^ 
t^o i Jo it) Pit) - 
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Proof. We need to turn back to the proof of Lemma ([T]) from which we pick 

J2 (t) _ ,p (t) /o^^^'^ ^^^U^ {t-p jt) x) dx 
Jo it) t C^'^j,Udt-p{t)x)dx 

And it suffices to get : 



C v^^.(i-pWx)fc ^ 



t->0 



We start with noting that 

C^'^^Udt-pit)x)dx 

_ lo V^Ui {t-p (t) dx + Ji*/^^*^ y/xfj^i (t-p (t) x) dx 
~ /o T.U^ it - P (t) ^) dx + Jt^'^'^ j=J-^. it - p (t) x) dx 
^ lo -j^U^ (t-p (t) x) dx + jl'''^^ \fxj+i {t-p (t) x) dx 
~ lo T^U^ it - p it) X) dx + /;/^(*) ^/^. it - p it) x) dx 

jl''^'^V^U^ (t-p{t)x)dx 



< 1 



lo 7sU^ it- p it) x) dx 
We deal with the denumerator 

/ -^f^^it- p{t)x)dx>f^,{t- p{t)) f -^dx = 2U 

Jo yx Jo yx 

and 

jl''^'^ V^Ur it - P it) X) dx ^ 1 /•*/^(*) f^, {t-p{t)x) ^^ 



it- Pit)) 



jl^J^^^t-p{t)x)dx U^it-pit)) 

Then we we rewrite 

it - p it) x) ((^ - P (^)) +Pit-P it)) ;;(^ (1 - x)) 

U^it-p{t)) ~ U:it-Pit)) 

^ U^iit-pit))+pit-p{t))yt) 

U^ it -Pit)) 
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with yt 
that 



p{t-p{t)) ^) • is plain that, ii yt = y does not depend on t 
U^{{t-p{t))+p{t-p{t))y) 



U^{t-P{t)) 



exp(y) 



Since — > 1 (see display 2.11.2 in Bingham, Goldie, Teugels (1987)) 
and by Proposition 3.10.2 ibidem. 



U^iit-pit))+pit-pit))yt) 



exp(l — x) 



U^{t-p{t)) t^o 
From this remark, proving the Lemma finally comes down to proving 



sup 

i,t J I 



We focus on 



f^i it) exp {-X 

{t- p (t) X 



exp (— x) exp dx < M. 



(38) 



f^i {t) exp (-x) ■ 

By the representation Theorem 3.10.8 in Bingham, Goldie, Teugels (1987) 
and since all functions f^i have he same auxiliary function p : 



{t-p{t)x) 
f^i (t) exp (-x) 



exp 



X 



du 



t-p{t)xP{u)_ ■ 



Now it is easily seen that p is continuous and nondecreasing in a neighborhood 
of (see the remark about this fact within the proof of Lemma [T]). Hence 
for t small enough 



—X 



Pit) 



p{t- p{t)x) 



< 



t—p{t)x 



du 
p{u) 



< —X 



and 



f^i {t- p (t) x) 



< 1 



f-Li (t) exp (-x) 

for all < X < t/p (t) and for t close to zero. At last (|38l) holds, hence (|3711 
hence Lemma [5l ■ 

Proof of Theorem [2] : 

In order to finish the proof of the Theorem we have to cope now with 
rP (see (El) since Lemma H] provides a fair estimate with F^. We have to 
prove that : 



F 



#d 

K 



0{v{h)) 
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Actually we will prove that this bound is true in Hilbert-Schmidt norm 
since the Hilbert-Schmidt norm ofrf is easier to handle than its sup-norm. 
We have ( I32b[) in mind and we start from : 



J{v)- 



dudt 



This display was obtained from ( l33i) by a change of variable. Introducing 
again the function ipi (see above) : 

h it) fj (u) = /, (0) f, (0) (1 + y., (t)) (1 + (u)) 

hence 



We see that 



/ / 7P=f=F (1 + (1 + '/^^ («)) U^J Wv' -n^- t') '^[.>Vu^}dudt 

since obviously 





= (t) /^ij -m2 _t2j = 0. 



We treat the numerator and the denumerator separatedly. Let 
Denoting again 




= sup \(pi 
teVo 
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we have 



and 



It is plain that for sufficiently large i and j', 

1 — — — ajOj > 

hence 

t/ (i') ^ ^ 

- (1 - a, - a, - a^a,-) / / (V^^^ _ ^2 _ ^2) n^^^^^.^^^^^^ 

and linij j^_|_oo + Cij + fli^j = hence is smaller than 0.5 for large i and 
j. Then we apply the same change of variable as in fl32al) . We get for i and 
i large enough : 

,,,,, !;t'^^^UAVv^')drde 

J [v] < laittj 5 — , 

/o /o 7^U^. iV^^) drde 

< 47rajajf ^ 

/o 7T=5/^iJ - a;2) dx 

Now we invoke Lemma [T] to get : 



We should check now that : 

V lo ^U^, (^yi - dx 

iim sup sup — — j— , < M 

The detailks of this step are omiied since they copy almost verbatim those 
of Lemma [5l 
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At last : 

J (t>) < lOvrajajp {v) 

for large i and j and small v. 

With this inequality in hand, we go back to (132bl) 



E 



K 



\X\ 
~h 



(X,e.) (X,e,) 



< lOTrajaj / v'^p (v) K j (f ) (it; 



from which we deduce that 



K 



and 



< 



<107r 



Xll^ll)^ 



|X| 



Since i^T has compact support we may say that ||X|| < h hence 

"1X1 



E \\xrpi\\x\\)K 



h 



K 



< hv (h) 



' +CXD 



Together with Lemma [Hand assumption ( l22l) this last inequality yields The- 
orem [21 

We are going to prove Proposition [7] but first we give a Lemma : 



Lemma 6 Let m, p ^ N : 

\Xi - xo\ 



E 



h 



\Xi — Xol 



K'^{l)h'PF{h) 



Proof. 



E 



\Xi — Xol 



h 



Xi-xoll 



ixi-xoir = 

Jo 

We apply Fubini's theorem. It is plain that : 

K"" {u) uP = K"" {1) - [ [s''K"'{s)]'ds, 
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hence 
-1 



• 1 



^pllXi-xoil/h / ^ 








[ir™ (s) s^]' ]l{o<„<.<i}rfpll^-^«ll/'^ (m) ds 



K"'{l)F{h) 

( 1 



[sPK"'{s)]' F{hs) ds 



\s^K"'{s)]'^^^ds 



F{h) 



which finally gives 
Xi - xo\ 



E 



h 



\Xi - Xo\ 



hPR"^ (1) F (h) t^"^' 



{s)] 



iF{hs) 



F{h) 



ds I . 



We deal with [K™" (s) s^]' ^^^ds and just have to show that this integral 
goes to zero when h does to prove the Lemma. Remind that assumption A2 
ensures that K (1) > and that sup^ [/^(s)'! < +00. Hence : 

sup < +00. 

s 

At last Fact 1 (see display ©) ensures that F (hs) /F{h) when s is 
fixed. Noticing that F [hs) / F [h) < 1 and Lebesgue's dominated conver- 
gence Theorem are enough to get the desired result and to complete the 
proof of the Lemma. ■ 

Proof of Proposition [7] : We begin with the first part of the Proposi- 
tion. We must prove that : 



v{h)=E 



K 



\Xi — Xq\ 



o E 



K 



h 

h 



\Xi -so||p(||Xi -xq\ 



\Xi - Xq\ 



By fllOl) and as p is a positive function, we can assume that p is non- 
decreasing in a neighborhood of hence that : 



E 



K 



\Xi - Xq\ 



< p{h)E 



h 



K 



|Xi-xo||p(l|Xi-a;ol 



\Xi — Xq\ 

h 



\Xi - xo\ 
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since the support of K is [0,1]. Then applying Lemma [U] with m = 1 and 
p = 1 we get 



E 



K 



\Xi - xqI 
h 



\Xi — xa 



K{l)hF{h). 



Then for h small enough : 



E 




-a;o||p( 


11^1- 


-a^oll) 


E 


f \\Xi-xo\\ 




l|2" 





< 



2K{l)p{h) hF{h) 



E 



K 



||Xi-xo|| 
h 



\Xi - xq\ 



(39) 

By Lemma [6] again with m = 1 and p = 2, the denumerator behaves like 
K (1) K^F (h) . At last since p (h) //i — > 0, the display above tends to zero. 
We go on with the second part of the Proposition. It is not difficult by 
copying the proof of Lemma E] to show that : 



v{h) = K{l)p{h) hF{h) 1 



^ [sK{s)p{hs)^ F{hs) 



ds 



(40) 



and 



[sK (s) p (/is)]' _K{s)p (hs) sK' (s) p (hs) hsK (s) p' {hs 



p{h) 



p{h) 



+ 



p{h) 



+ 



p{h) 



The first and second term on the right are uniformly bounded with respect 
to h and s since p is non decreasing in a neighborhood of zero and K and 
K' are bounded. We turn to the last. Remind that here p is assumed to 
be regularly varying at zero. From fllOj) we now that the index of regular 
variation of p is (i > 0. Now open the book by Bingham, Goldie and Teugels 
(1987). The definition of regular variation is given p. 18. from Theorem 1.7.2 
p. 39 we deduce that p' is regularly varying with index d — 1 and also that : 



lim sup 



tp' it) 



Pit) 



d 



which means that hsK (s) p' (hs) / p {h) is unformly bounded with respect to 
h and s for small h and < s < 1. Applying the dominated convergence 
theorem to ( l40|) yields the desired result. 



Proof of Theorem I 
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Simple calculations give : 



n 



E 



\Xi - Xq\ 



h 



\Xi — xo| 



We begin with computing E 
1^1 - XoW 



2 / \\Xi~xo\\ 



\Xi - Xo\ 



. Lemma [6] gives 



E 



h 



\Xi — xo\ 



K\l)h^F{h) 



Under the assumptions of Theorem [2] we also have : 

\\TK\\=0{v{h)) 

where (see ( l39l) ) : 

1 

and 



(41) 



\\^Kr = 

which also means that 



K{l)p{h) hF{h) 
O {[p (h) hF {h)f) = o {h^K^ (1) F (h)) 



E||r^,„-r;,f ~ -E 

n 



\Xi - Xq\ 



h 



\Xi — Xq\ 



n 



Theorem [3] is now proved. 
Proof of Corollary [T] : 

The proof of the first display, related with the eigenvalues, stems from 
the famous bound : 

sup|sp(T)-Sp(f/)|<||f/-T||^ 

where U and Y are compact linear operators from and onto H and Sp (T) 
stands for the p*'* characteristic number of the operator T. The proof of the 
second display, namely on eigenprojections, will be deduced from an article 
by Mas and Menneteau (2003) as announced sooner in the paper. 

Proof of Proposition [2] : We want to estimate P(||X|| < e) when e 
goes to 0. In order to understand these few lines, the reader is referred to 
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Dembo et alii (1995). We have to compute or to give asymptotic equivalents 
for formulas (3), (4) and (5) in their article. Let 9 — 9 (e) be the unique 
solution of : 

fx{9)^e 



where here 



We begin with 



+0O 



"^^^ ^exp(m) + 2^' 



Then 



" 5 exp {at) + 29 ^ / 



dx 



exp [ai) + 29 Ji exp (ax) + 29 

1 r-p(-") du _ log(l + 2gexp(-a)) 
a Jo l + 29u " 2^ 



(42) 



+ 00 

2E 



'\ ^ vexp (m) + 29 



2 / ^+oo 

~ ^W2 



dx 



(exp (ax) + 2^)^ 



a 



(1 + 2^1^)^ 



1 /, /-. / 26* exp (—a) 

— W log 1 + 2^ exp -a - \ \ 

2a\l fy JJ l + 29ex.p{-a) 



At last 



(43) 



i=l 



We focus on 

+00 

2 



-5^1og(l + 2^exp(-m)) ~ - / log (1 + 2^exp (- 
i=i "'1 



ax)) dx. 
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Setting u = 26'exp {—ax) this last integral becomes 

p + oo 

- I log (1 + 29 exp {—ax)) dx 
2 Ji 

1 /'^^""P^-") log(l+M) 



2a; Jo u 

1 /•2eexp(-a)j 



-du 



2a Ji u 
2a A 



^^*< = — [log(2eexp(-a))l- 



~i-|log«l^ 
From (I13I) we see that : 



I {9) 



i-A^og9Y i-A^og9Y 

where p {9) tends to 1 when 9 goes to infinity. Then from fl42l) we get : 

g/i {9) 4a 
^[hg9]'^hi9 

and 







Collecting our results we have the following final asymptotic equivalence 

log {e) 



9 



fx {9) =6 



2ae 
2a9 



J_[log(())f ^i-[log(£)l^ 

Collecting these formulas together with display (10) in the above-mentioned 
article we get : 
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